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Abstract 

This paper introduces and analyzes a stochastic search method for parameter estimation in linear 



regression models in the spirit of Beran and Millar ( 1987 1. The idea is to generate a random finite 



subset of a parameter space which will automatically contain points which are very close to an 
unknown true parameter. The motivation for this procedure comes from recent work of Diimbgen 



|Samworth and Sch uhmacher (201 1) on regression models with log-concave error distributions. 
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1 Introduction 



This paper introduces and analyzes a stochastic search method for parameter estimation in linear 
regression models in the spirit of Beran and Millar ( 1987 ). The idea is to generate a random finite 
subset of a parameter space which will automatically contain points which are very close to an 



unknown true parameter. The motivation for this procedure comes from recent work of Diimbgen, 



Samworth and Schuhmacher (2011 1 on regression models with log-concave error distributions. 
Section [2] reviews the latter setting. In section [3] the stochastic search method is described and 
analyzed in detail. Our construction relies on the exchangeably weighted bootstrap as introduced 



by |Mason and Newton| ( |T992| ) and developed further by Prsestga ard and Wellner| ( |1993| ). While 
these papers are dealing with i.i.d. random elements, the present considerations will show that the 
exchangeably weighted bootstrap is also asymptotically valid in heteroscedastic linear regression 
models under mild regularity conditions. Thus it is a viable alternative to the wild bootstrap as 
proposed by |Wu| ([T986). All proofs are deferred to section|4j 



1 



2 Linear regression with log-concave error distribution 



Suppose that for integers q and n > gwe observe (x n \, Y n \), (x n 2, Y n 2), . . . , (x nn , Y nn ), where 

Y n i — Q n X n i + € n i 

with an unknown parameter n G R 9 , fixed design vectors x n i,x n 2, ■ ■ ■ ,x nn G R 9 and in- 
dependent real random errors e n i, e n 2, • • . , e nn with mean zero. We assume that our regres- 
sion model includes the constant functions, i.e. the column space of the design matrix X n := 
[x n i,x n 2, ... , Xnn] 7 contains the constant vector (1)" =1 . 



Maximum likelihood estimation. Suppose that the errors e n i are identically distributed with 
density f n such that tp n := log/ n is concave. One may estimate f n and n consistently via 
maximum likelihood as follows: Let <1> be the set of all concave functions 4> '■ K — > [—00, 00) 
such that 

f e^dy = 1 and f yS y) dy = 0. 
Then we define (ij) n , n ) to be a maximizer of 

n 

^24>(Y ni - r) T x ni ), 

i=i 

over all pairs (<fi, 77) G $ G x M. q , provided such a maximizer exists. It follows indeed from 



Dumbgen, Samworth and Schuhmacher (20111 that (^ n ,9 n ) is well-defined almost surely if 



n > q + 1. Precisely, the MLE exists whenever Y n = (Y n i)f =1 is not contained in the col 
umn space of the design matrix X n . Simulation results in Dumbgen, Samworth and Schuhmacher 



(2011 1 indicate that n may perform substantially better than the ordinary least squares estimator, 



for instance when the errors have a skewed, log-concave density. 



Consistency. General results of Dumbgen, Samworth and Schuhmacher ( 20"TT| ) imply that the 



MLE is consistent in the following sense, where asymptotic statements refer to n — > 00, unless 
stated otherwise: 

Theorem 2.1 Suppose that q = q(n) such that q(n)/n — > and 

)fn(y)-f(y)\dy -> 

for some probability density f. Then f n := exp(^ n ) satisfies 

/ \fn(y) - fn(y)\dy ->-p 0, 
Jm 

and 



1 

- ^min(|(0 n - O n ) T x n i\, l) -> p 0. 



n 
i=l 
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For fixed dimension q and under additional conditions on the design points x n i, Theorem 2.1 
implies a stronger consistency property of 6 n , where || • || denotes standard Euclidean norm, and 
A m in(^4.) denotes the minimal eigenvalue of a symmetric matrix A: 



Corollary 2.2 Suppose that the assumptions of Theorem 2.1 are satisfied, where the dimension q 
is fixed. In addition, suppose that 



and 



1 

liminf A min ( - ^ x ni x^ \ > 

n— »oo Vn * — ' 

1=1 



lim - ^ l{||aj ni || > c}||a3 ni || 2 = 0. 

n,c— >oo n *■ — » k J 
i=l 



Then 

\\0n — Qn\\ — >p 0. 

3 Stochastic search 

Computing the MLE (t/j n , 6 n ) from the previous section is far from trivial. For any fixed rj 6 R 9 , 
the profile log-likelihood 

n 

L n (rj) := max V </>(Y ni - x^rj) 
</>e<i> f— f 
i=i 



can be computed quickly by means of algorithms described by Diimbgen and Rufibach (2011 1. 



Furthermore, as shown by Diimbgen, Samworth and Schuhmacher (2011), L n (-) is continuous 



and coercive in that L n (rj) — > — oo as \\rj\\ — > oo. However, numerical examples reveal that L n {-) 
is not concave or even unimodal in the sense that the sets {r/ € W 1 : L n (rj) > c}, c G M, are 
convex. 



To deal with this problem, we resort to a stochastic search strategy in the spirit of Beran and 



Millar ( 1987 ). In particular, we construct a random finite subset @ n of such that 



(1) min n 1 / 2 ^ - n \\ -K, 0. 

>jee„ 

Then we redefine 6 n to be a maximizer of L n {-) over n . A close inspection of the proofs reveals 
that the consistency results in Theorem |2.1| and Corollary |2.2| carry over to this new version. 
Moreover, if the original MLE n satisfies \\0 n — 6 n \\ = O p (n -1 / 2 ), which is an open conjecture 
of ours, the same would be true for the stochastic search version. 

Exchangeably weighted bootstrap. For the remainder of this section we describe and analyze 
a particular construction of n : Let Wn \ Wn \ W^n \ ... be i.i.d. random weight vectors in 
[0, oo) n , independent from the data (X n , Y n ). Then we consider the ordinary least squares esti- 
mator 

n n - n 

0n } ■= argmin V(F n i ~ x^r)) 2 = (S^x^ni) 



■ T 



i=l i=l i=l 
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and the randomly weighted least squares estimators 

n n \ n 

0^ := argmin^^^-^) 2 = E^^xS" Y. W ni Y m x ni 

for 6 = 1, 2, 3, . . ., where W<?> = {W^)U- K E"=i or Eti W^^™^ ha PP ens to 

be singular, we interpret its inverse as generalized inverse. If we define 

6 n := {Of :0<b<B n } 

with integers B n — > oo, the subsequent considerations imply that ([T]) is satisfied under certain 
conditions. 

Asymptotics. We assume that the random weight vectors W n := w[ satisfy the following 
three conditions: 

(W.l) The random variables W n \, W n 2, ... , W nn are exchangeable and satisfy 



n 
i=l 

(W.2) For a given number c > 0, 



^ 2 > c 2 



(W.3) As n — >■ 00 and K — > 00, 

1 n 

-^^l{^ ra >iv-} ^ p 0. 
i=l 

Note that (W.l) implies that IE W n \ = 1. In fact, when (W.l) holds, conditions (W.2-3) are a 
consequence of the following moment conditions: 

(W.4) For a given number c > 0, 

Var(W nl ) -> c 2 . 

Moreover, 

limsupCov(W 2 1 , W 2 2) < and limsupIE(W^ 1 ) < 00. 

n.— >oo n— ¥00 

To see this, observe that under (W.l) and (W.4), 

ni) -> c 2 and 



^ n 1=1 j 

Varjif:^-!) 2 } = Var(i£w&) 
^ i=l J v i=l 7 



= - Var(W 2 1 ) + — Cov^i, W n2 ) 
n n 

re 
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as n — > oo, which proves (W.2). Moreover, 

= nw^i{w nl >K}) < nw^)/K 2 -> o 

in i=i j 

as n — > oo and if — > oo. This proves (W.3). 

As to the data (X n , Y n ), we drop the assumption of identically distributed errors and only 
require the e n i to have mean zero and finite variances. Further we assume that the following three 
conditions are satisfied: 

(D.l) For a fixed positive definite matrix T G U. qxq , 

i n 

(D.2) For a fixed matrix T £ G R qXq 



n 
i=l 



£ni) x n i x ni 

n * — ' 

1=1 



(D.3) With L ni := n-\\ + e^)||a; n i|| 2 , 



IE L ni mm(L ni , 1) -> 0. 

i=l 

Note that (D.l-2) implies that IE ^™ =1 — >• trace(r+r e ). Even under the weaker condition 
^ S™=i L n i = 0(1), condition (D.3) is easily shown to be equivalent to the following Lindeberg- 
type condition: 

(D.3') For any fixed 5 > 0, 

n 

M^L ni l{L ni >S} -> 0. 

i=l 

Theorem 3.1 Suppose that conditions (W. 1-3) and (D. 1-3) are satisfied. 

(a) For any fixed integer B > 1, 

n 1/2 (tf } -0n)f =o -+ c r-\zW + i{b>i}czW)l 

with independent random vectors Z^\Z^\Z^ 2 \ Z (B) having distribution J\f q (Q, T e ). 

(b) For arbitrary integers B„ — > oo, 

min n 1/2 \\e { ^ - II 0. 

Part (a) of this theorem is illustrated in Figure [l] Asymptotically, 0^ (depicted as •) behaves 
like 6 n (depicted as *) plus rr l l 2 Y~ x Z^°\ From the latter point one gets to 0^ , b > 1, by adding 
another Gaussian random vector cn~ l / 2 T~ l Z^ b \ Writing C{A) for the law of a random vector 
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Figure 1 : Illustration of Theorem 



3.1 



(a). 



A, the ellipses with broken lines indicate C{0 n ), while the ellipses with solid lines indicate 
^\Y n ). 

Note that for any fixed integer B > 1, 

min n^U^ -e n \\ ^ c min \\T-\Z^ + cZ^)\\. 
b=l,...,B 11 11 b=l,...,B" 11 

The next result provides a more detailed analysis of the latter random variable in terms of the 
way its distribution depends on I] := r _1 r e r~ 1 and B. Recall that the Weibull distribu- 
tion Weibull((?) is defined as the distribution on [0, oo) with distribution function F(x) := 1 — 
exp(— x q ). 

Theorem 3.2 Let Z\, Z2, Z3, . . . be independent random vectors in ~K d with continuous den- 
sity f. For any fixed z£l', 

a„f{z) l/q B 1/q min \\Z b -z\\ ^ c Weibu%) 

b=l,...,B 

as B -> 00, where a q := ir l ^T(q/2 + l)- l / q . 

Presumably this result is well-known to people familiar with nearest neighbor methods, but 
for the reader's convenience a proof is given in section [4j It implies the following result for our 
particular setting: 



Corollary 3.3 Let Zq, Z\, Z2, ... be independent random vectors with distribution N q (0, S), 
where is nonsingular. Then for any fixed c > 0, 

B 1 ^ min \\Z + cZ b \\ ^ c B det(E) 1 /^cexpf^W 
b=l,...,B H \2c z q/ 

as B — > 00 with independent random variables S 2 ~ x\ an d W ~ Weibull(g), where (3 q := 

2 1 /2r(g/2 + l) 1 /?. 

If we drop the assumption that £ is nonsingular, the conclusion of Corollary |3 . 3 1 remains true 
if we replace q with rank(S) and det(£) with the product of the nonzero eigenvalues of X. 

The previous result shows that mim,^ __b \\Zq + cZf,\\ is of order O p (B~ l l q ) as B — > 00. 
This means, roughly speaking, that to achieve a small approximation error 5 > 0, one has to 
generate 0(5~ q ) points. This is coherent with the well-known fact that a Euclidean ball with 
fixed (large) radius can be covered with 0(5~ q ) but no less balls of radius 6. However, note that 
the limiting distribution also depends on det(S). If we fix trace (E) = E(||.Z&|| 2 ) but decrease 
det(Sl), the asymptotic distribution of the minimal distance gets stochastically smaller. 



For large dimension q, the stochastic factor c exp(S 2 /(2c 2 (7)) in Corollary 3.3 can be ap- 
proximated by c exp(l/(2c 2 )), because JE(S 2 /q) = 1 and V&r(S 2 /q) = 2/q. Differentiation 
with respect to c reveals that c = 1 is the unique minimizer of the latter approximate factor. 
Hence choosing c = 1 is approximately optimal in high dimensions. Alternatively, one could use 

c = Cq := Median(5 2 /g). 



Examples of weighting schemes. Prsestgaard and Wellner ( 1993 ) describe many different weight 



ing schemes satisfying (W.l-3). Let us just recall two of them: 

Sampling uniformly at random with replacement (the usual bootstrap sampling scheme) corre- 
sponds to a weight vector W n with multinomial distribution Multi(n; n , n _1 , . . . , n _1 ). Here 
one can show that (W. 1) and (W.4) are satisfied with c = 1. 

Another interesting strategy is subsampling without replacement: For a fixed integer m n £ 
{1, . . . , n — 1} let W n be a uniform random permutation of a vector with m n components equal 
tora/m n andn-m„ components equal to zero. Then^™ =1 W n { = raandn -1 Yli=i(Wni—l) Z = 
n/m n — 1. The latter expression converges to c 2 if, and only if, m n /n — > (c 2 + l) -1 . In that case, 
rT x Ya=i W ni l i w m > K} = for sufficiently large n, provided that K > c 2 + 1. Note that 
c = 1 is achieved if m n /n — > 1/2. 

Asymptotic validity of the bootstrap. As a by-product of Theorem |3.1| we obtain the asymp- 
totic validity of the exchangeably weighted bootstrap for the case c = 1. Precisely, with "S = 

r _1 r e r -1 , 

C{n l ' 2 (ef - 9 n )) ^ w A/- 9 (0,£) 

and 

Cin 1 ' 2 ^ -e^)\Y n ) -+ w>p AT ? (0,c 2 E), 
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where -^ W)P stands for weak convergence in probability. This latter assertion means that 



G n :=E( 5 (nV2(0«_0f)) 



for any bounded and continuous function g : W 1 — > M, where Z ~ M g (0, S). To verify this, we 



employ a trick of Hoeffding ( 1952 ): It follows from Theorem 3. 1 that 

„v» (i w -a?,*?- «f) 

converges in distribution to (cZi, CZ2) with independent copies Zi, Z2 of Z. Hence 

EG n = Mg^ie^-Of)) -> ^g(cZ). 
Furthermore, by independence of Wn , Wn and Y n , 

m{Gl) = ElE( 5 (n^(^)_^)). 5(n i/ 2 (^_^)))|y n ) 

= TE(g( n v\e-e))- 9 (nne-oT))) 

-> m[g{cZ x ) ■ g{cZ 2 )) = {JEg(cZ)) 2 , 
whence Var(G n ) — > 0. 

4 Proofs 

Proof of Corollary |2.2| It suffices to show that for any nonrandom sequence (r] n ) n in M. q , 

1 - 

-2^min(|a;^»7 n |,l) -»■ 



8=1 



implies that rj n — >• 0. To this end we write r\ n = \\r) n \\u n with a unit vector u n £ M 9 . For any 
fixed number e > 0, it follows from ||?7 n || > e that 



-5^min(|aj^»7 n |,l) > -^mm(e 2 |a4« n | 2 ,l) 

i=l i=l 

1 n 

> - ^2(e 2 (XniU n ) 2 - l{e||x ni || > l}e 2 ||a;„i 

^ n n 
~' ' ' !' -Vnin ( — ^ x ni x nij ~ ~ ^ l{\\ x n&\\ > 1/ e }ll a; ni|| 2 ) • 



i=l 



But the lower bound on the right hand side is bounded away from zero, provided that e > is 
sufficiently small. This shows that \\rj n \\ < e for sufficiently large n. □ 



In our proof of Theorem 3. 1 we make repeated use of the following elementary lemma: 
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Lemma 4.1 For some n > 2 let V = (V^)f =1 G [0, oo) n and Mi,M 2 , . . . , M n G M d be 
independent random vectors, where V is a uniform random permutation of a fixed vector v = 
(vi)^ =1 € [0, oo) n while IE \\M i\\ < oo for 1 < i < n. Then for an arbitrary constant K > 0, 



JE^Q^ViMi-v^MMi < 2R{K)S + 2vL + (-^—^KvL 



i=l 



i=l 



1/2 



where v := n Y27=l v i an ^ 



R{K) 



S 



L 



1 n 

- y^vdivi > k}, 

i=l 

n 

^E||Mi|| ; 
i=i 

n 

5^E||Mi||min(||Mi||,l). 



Proof of Lemma ICT Let V- := Vil{Vi > K} and := Vil{Vi < K}. The corresponding 
means are R{K) and w := rT 1 Y^l=i v il{ v i — ^} < ^» respectively. Then 

n n 

E|^^Mi-'0^IEMi| 

i=i i=i 

n n n n 

< Ell^WiMi -tD^IEMJI +J2^ V i\\ M i\\ +^(^)||X] IEM ' 



i=l 
n 



i=l 
n 



i=l 



< m\^W i M i -w^JE,Mi\\+2R(K)S. 

i=l i=l 

Further, let M\ := min(||Mj||, 1)M; and N t := (1 - \\Mi\\) + Mi. Then 

n n 

i=l i=l 

n n n n 

< Ell^WiJVj- w^EJvJI +J^lEWi||M-|| +u;|5^]EMj 

i=l i=l i=l 

n n 

< TE\[^W i Ni-w^2jEN i \\+2vL. 



i=l 



i=l 



i=l 



Finally, 



Ell WiNi-w T® N i 



i=l 



W^2(WiNi--EWiNi) 

K i=l 

n 

< trace Var^^WjiVj 



i=i 



^2 tr&ceCoviWiN^WjNj). 
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But 

trace Var(WiJVi) < IE(P1^ 2 1| iV^ || 2 ) = E(Wf) E([|JV<|| 2 ) < ifi/E ||M$| 
and for i ^ j, 

trace CovfWiiVijWjiVj-) = E(W i W 3 -JVj r JV j ) - w 2 (E A/"i) T (E AT,-) 

= (E(WjWy) - w 2 )(EJVj) T (EiV : j) 



1 n 

(- V l{k / £}WkWi — w 2 ](EJV 8 ) T (]EJVj) 

\n(n — lj ,^7^ / 



n 9 



1 n 

— ^^|-u) 2 )(EAr i ) T (EAr J ) 



n 



n — 1 n(n — 1) ^— ' 

v ; k=i 

~ l - Var(W 1 )(EAT l ) T (EAT i ). 



Consequently, 

n n 
i=l i=l 

< ifuL -Var(Wi) V l{i / j}(E A";) T (E AT/ 

n — 1 z — ' 

= i-CuL H — Var(Wi) II E A^ll 2 — Var(Wi)|| V E JV,- 

n — 1 z — ' n—1 W^-^ 

i=l i=l 
1 n 

< KvL + EfV^ 2 ) Ve(||AT ? 

n — 1 



i=i 



n 

< ETuL. 

n — 1 



Proof of Theorem 13. 11 We start with part (a). Note first that 



~ 9 n ) = T-lZ n , 



for b = 0, 1, 2, . . . , B, where 



x n,6 •— / 4 yy n i ni ni > 

i=l 



n 



- 1/2 E^ fe) ' 

i=l 



with := 1. By Slutsky's lemma, it suffices to show that 



(2) r n>6 ^ p r for 6 = 0,1,..., 5, 

1 ^ u i v. 1 ■■■■ a- i -} / i > i v/ - 'x. ' , 

'6=0* 



(3) K 6 )f= (^ (0) + 1{6>1}cZW); 



□ 
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Since T rh Q = n 1 ^27=1 x ni x ni converges to T by assumption (D. 1), claim Q is equivalent 



to 



(4) "E^ 



. „ ni^m^ni ~P *- • 

n — ' 

i=i 



Concerning claim ([3]), note that (Z n> b)^ = n l / 2 Y^i=i e mA n i with 

A ■ — (W {b) T ) B 

If we condition on the weight vectors Wn , the A n i are fixed vectors in M. q ^ B+1 K Thus the multi- 
variate version of Lindeberg's central limit theorem implies claim ([3]>, provided that the following 
two conditions are satisfied: 

1 n B 
(5) - V Var(e ni )A ni AT -> Varf (z<°> + 1{6 > 1}cZ^) 

n ^-^ V V / 6=0 

i=l 



1 " 

(6) IE* - ^e^||A n j|| 2 l{e^||A n j|| 2 > nS} -> p for any fixed 6 > 0. 

n i=l 

where IE* denotes conditional expectation, given the weight vectors Wn . Due to the special 
structure of A n i, and in view of (D.l) and (D.3), the two claims ([5]) and ([6]> are easily shown to be 
equivalent to the following four statements: 

1 n 2 T 

(7) ie* — y w n i€ ni x ni x ni — >p r e , 

i=i 



(8) 



1 n 2 2 T 2 

IE* — > W ni e ni x ni x ni — > p (1 + c )r e , 



n 
1=1 



1 . _ 

(9) iE*-E w i 1)w i? e n^™4i r 6> 

1=1 

and 

1 n 

(10) lE^^JW' 2 i e ni ||a; n i|| 2 l{W'^||a; ni || 2 > ™5} ^ p 0, for any fixed S > 0. 

n i=i 

All claims Q, (|7]), ([8]), Q involve a random matrix of the form 

n 

ie, ^ y ni M 



i=i 



where Vn? denotes W n j, V7 2 j or W n ^W n 2 ^ and M ni stands for n^x^x^ or n^e^x^x^. Let 
IE D denote conditional expectation, conditional on the order statistics of each weight vector Wn ■ 
That means, we consider each Wn as a random permutation of a fixed weight vector. With 
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V n := n 1 YH=i Vni and treating matrices in ~K qxq as vectors in M. q2 , it follows from Lemma 
that for arbitrary K > 1, 



4.1 



i=l 



i=i i=i 

= E 1 1 ^ VniMni - V n ^ E M. 



i=l 



i=l 



< 2R n (K)S n + 2V n L n + 



n 



n — 1 



1/2 



where 



R n {K) := n- 1 jr i V r *l{V n i>K}, 

i=i 

n n 

5„ := ^E||M m || < -^(1 + Var(e 



ni ) } W^ni 



x n i\\ 2 -> trace(r + r e ), 



i=l 
n 



i=l 



i=l 



L n := ^E||M ni ||min(||M ni ||,l) < E^L ni mm(L nij 1) -»• 0, 
i=l 

according to (D. 1-3). Note also that 

1 n 



i=l 



x ni x ni ~~ ^ ^ 



if Af^j — n x ni x ni , 



i=l 
n 



— ^ Var(e n j)a; n jg;^ 



»; ~~ ^ ^ if-^rai — n le ni X ni X ni- 



i=l 



Thus it remains to verify that 

(11) #n(if) ^ P asn,iT^oo, 

and that 



V, 



n r p 



' 1 if Vni = W ni or V ni = W$ W$ , 

1 + c 2 ifK i = W < ?.. 



Case 1: V n i = W n i. It follows from the Cauchy-Schwarz inequality that 

1 n 

Rn(Kf < -J2KMWni>K}, 



i=l 



so ( 1 1 ) follows from (W.3). Moreover, V n = 1. 



Case 2: V n i = W}? . Condition ( [TT] ) follows from the previous consideration and 



i n 

VoRn(K) < V ±Y t W £ )w 2\m£ ) >KV 2 } + l{wW>K^}) 
1=1 

1 n i n 

= £ E w£>i{w£> > + i 53 > ^ 1/2 ). 



i=l 



i=l 



12 



Furthermore, elementary calculations reveal that 
E K = 1, 

^ n n 

V^o(V n ) = ^—^ £(w£> - l) 2 Y,(< ] - l) 2 = OpCn" 1 ) 



i=i 



by (W. 1-2), soK ^ p 1. 

Case 3: P^j = Wi?;. Here condition dTTb is just (W.3), while 



1 n 1 n 

Vn = ~Y. W ni = l + -^(^m-l) 2 ^ P 1 + C 2 



n * — * n 

1=1 1=1 

by (W. 1-2). 

Concerning part (b), for any fixed 5 > 0, it follows from part (a) and the continuous mapping 
and portmanteau theorems that for any fixed integer B > 1, 

lim sup P ( min n 1/2 1 1 0® - n \\ > 8 

< limsup p( min n 1/2 ||0^ &) - n \\ > 5 



< p( min llr- 1 ^ +cZ®)\\ > s). 

\b=l,2,...,B 11 11 / 

But Theorem [3]2] implies that the right hand side tends to zero as B — > oo. □ 

Proof of Theorem 13.21 We write B(o, r) for the closed ball in M. g with center at a and radius r. 
Set jb,z := Note that ctq is the (/-dimensional volume of B(0, 1). Thus 

p( 7i?iZ min \\Z b -z\\>x) = p('z b 0B(2,x/7B,z)for6 = l,...,B) 

= w(^Z 1 ^M(z,x/ 7 b,z)) B 

= ( 1 - / /(y) dy) 

V JB(z,a;/7 S>i ) / 

= (l-<(x/ 7B ,^(/(z) + (l))) B 

= (l -£rV + «(!))) * 
— > exp(— x q ) 

as B — > oo. □ 
Proof of Corollary |3.3| If we condition on Zq, it follows from Theorem 3.2 that 

B l/q min \\Z + cZ b \\ = cB 1/q min ||Z 6 - (-Z /c) II 
6=1, ...,B 6=1,... ,-B" 11 

converges in distribution to 

ca^fiZo/cr^W, 
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where W ~ Weibull(g) is assumed to be independent from Zq. But 



ca, 



q 



'/(Zo/c)- 1 ^ 




and ZlS _1 Z l 




□ 
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